Controlled Lagrangians and Stabilization 
of Discrete Mechanical Systems I 

Anthony M. Bloch, Melvin Leok, Jerrold E. Marsden, and Dmitry V. Zenkov 



r» ■ 
o ■ 
o : 

(N ■ 

sh ; 

<: 
o ■ 

u' 
o 

c3 



> 

in 

oo 
m 

o 
o 



Abstract — Controlled Lagrangian and matching techniques 
are developed for the stabilization of relative equilibria and 
equilibria of discrete mechanical systems with symmetry as well 
as broken symmetry. Interesting new phenomena arise in the 
controlled Lagrangian approach in the discrete context that are 
not present in the continuous theory. In particular, to make 
the discrete theory effective, one can make an appropriate 
selection of momentum levels or, alternatively, introduce a new 
parameter into the controlled Lagrangian to complete the kinetic 
matching procedure. Specifically, new terms in the controlled 
shape equation that are necessary for potential matching in the 
discrete setting are introduced. The theory is illustrated with 
the problem of stabilization of the cart-pendulum system on an 
incline. The paper also discusses digital and model predictive 
controlers. 



I. Introduction 

The method of controlled Lagrangians for stabilization 
of relative equilibria (steady state motions) originated in 
Bloch, Leonard, and Marsden [5] and was then developed in 
Auckly [1], Bloch, Leonard, and Marsden [6], [7], [8], Bloch, 
Chang, Leonard, and Marsden [9], and Hamberg [12], [13]. 
A similar approach for Hamiltonian controlled systems was 
introduced and further studied in the work of Blankenstein, Or- 
tega, van der Schaft, Maschke, Spong, and their collaborators 
(see, e.g., [21], [22] and related references). The two methods 
were shown to be equivalent in [10] and a nonholonomic 
version was developed in [25], [26], and [2]. 

In the controlled Lagrangian approach, one considers a 
mechanical system with an uncontrolled (free) Lagrangian 
equal to kinetic energy minus potential energy. To start with, 
one considers the case in which the Lagrangian is invariant 
with respect to the action of a Lie group G on the configuration 
space. To stabilize a relative equilibrium of interest, the kinetic 
energy is modified to produce a controlled Lagrangian which 
describes the dynamics of the controlled closed-loop system. 
The equations corresponding to this controlled Lagrangian 
are the closed-loop equations and the new terms appearing 
in those equations corresponding to the directly controlled 
variables correspond to control inputs. The modifications to 
the Lagrangian are chosen so that no new terms appear in 
the equations corresponding to the variables that are not 
directly controlled. This process of obtaining controlled Euler- 
Lagrange equations by modifying the original Lagrangian is 
referred to as kinetic matching. 

One advantage of this approach is that once the form of 
the control law is derived using the controlled Lagrangian, the 
stability of a relative equilibrium of the closed-loop system can 
be determined by energy methods, using any available freedom 



in the choice of the parameters of the controlled Lagrangian. 
To obtain asymptotic stabilization, dissipation-emulating terms 
are added to the control input. 

The method is extended in [9] to the class of Lagrangian 
mechanical systems with potential energy that may break 
symmetry, i.e., there is still a symmetry group G for the kinetic 
energy of the system but one may now have a potential energy 
that need not be G-invariant. Further, in order to define the 
controlled Lagrangian, a modification to the potential energy is 
introduced that also breaks symmetry in the group variables. 
After adding the dissipation-emulating terms to the control 
input, this procedure allows one to achieve complete state- 
space asymptotic stabilization of an equilibrium of interest. 

The main objective of this paper is to develop the method of 
controlled Lagrangians for discrete mechanical systems. The 
discretization is done in the spirit of discrete variational me- 
chanics, as in [20]. In particular, as the closed loop dynamics 
of a controlled Lagrangian system is itself Lagrangian, it is 
natural to adopt a variational discretization that exhibits good 
long-time numerical stability. This study is also motivated by 
the recent development of structure-preserving algorithms for 
the numerical simulation of discrete controlled systems, such 
as recent work on discrete optimization, such as in [11], [15], 
[16]. 

The matching procedure is carried out explicitly for discrete 
systems with one shape and one group degree of freedom 
to avoid technical issues and to concentrate on the new phe- 
nomena that emerge in the discrete setting that have not been 
observed in the continuous-time theory. In particular, it leads 
one to either carefully select the momentum levels or introduce 
a new term in the controlled Lagrangian to perform the discrete 
kinetic matching. Further, when the potential shaping is carried 
out, it is necessary to introduce non-conservative forcing in the 
shape equation associated with the controlled Lagrangian. 

It is also shown that once energetically stabilized, the 
(relative) equilibria of interest can be asymptotically stabilized 
by adding dissipation emulating terms. The separation of 
controlled dissipation from physical dissipation remains an 
interesting topic for future research; even in the continuous 
theory there are interesting questions remaining, as discussed 
in [24]. 

The theoretical analysis is validated by simulating the 
discrete cart-pendulum system on an incline. When dissipation 
is added, the inverted pendulum configuration is seen to be 
asymptotically stabilized, as predicted. 

The discrete controlled dynamics is used to construct a real- 
time model predictive controller with piecewise constant con- 
trol inputs. This serves to illustrate how discrete mechanics can 
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be naturally applied to yield digital controllers for mechanical 
systems. 

The paper is organized as follows: In Sections [II] and [III] 
we review discrete mechanics and the method of controlled 
Lagrangians for stabilization of equilibria of mechanical sys- 
tems. The discrete version of the potential shaping procedure 
and related stability analysis are discussed in Section [IV] The 
theory is illustrated with the discrete cart-pendulum system 
in Section [V] Simulations and the construction of the digital 
controller are presented in Sections [VT] and IVIII 

In a future publication we intend to treat discrete systems 
with nonabelian symmetries as well as systems with nonholo- 
nomic constraints. 

II. An Overview of Discrete Mechanics 

A discrete analogue of Lagrangian mechanics can be ob- 
tained by considering a discretization of Hamilton's principle; 
this approach underlies the construction of variational integra- 
tors. See Marsden and West [20], and references therein, for 
a more detailed discussion of discrete mechanics. 

Consider a Lagrangian mechanical system with configura- 
tion manifold Q and Lagrangian L : TQ — » M. A key notion is 
that of a discrete Lagrangian, which is a map L d : Q x Q — > M 
that approximates the action integral along an exact solution 
of the Euler-Lagrange equations joining the configurations 

qk,qk+i e Q, 

eh 



L (q k ,qk+i) 



ext 



qeC([0,h],Q)J 

where C([0, h], Q) is the space of curves q : [0, h] 



L(q,q)dt, (1) 
■* Q with 



q(0) — qk, q(h) = qk+i, and ext denotes extremum. 

In the discrete setting, the action integral of Lagrangian 
mechanics is replaced by an action sum 

N-1 

S d (q ,q 1 , ...,q N )= ^ L d (q k ,q k+1 ), 

k=Q 

where q k £ Q, k = 0, 1, . . . , N, is a finite sequence of points 
in the configuration space. The equations are obtained by 
the discrete Hamilton principle, which extremizes the discrete 
action given fixed endpoints go an d IN- Taking the extremum 
over gx> • • • j QN—i gives the discrete Euler-Lagrange equa- 
tions 

D^q^qk+x) + D 2 L d (q k ^,q k ) = 0, 

for k = l,...,N—l. This implicitly defines the update map 
$ : Q x Q ^ Q x Q, where $(g fe _i, g fe ) = (q k ,q k+1 ) and 
QxQ replaces the phase space TQ of Lagrangian mechanics. 

Since we are concerned with control, we need to consider 
the effect of external forces on Lagrangian systems. In the con- 
text of discrete mechanics, this is addressed by introducing the 
discrete Lagrange-d 'Alembert principle (see Kane, Marsden, 
Ortiz, and West [17]), which states that 

n—1 n—1 

S J2 Ld (Qk,Qk+i) + J2 Fd (9k,Qk+i) ■ (6q k ,5q k+1 ) = 

fc=0 fc=0 

for all variations Sq of q that vanish at the endpoints. Here, q 
denotes the vector of positions (qo, <7i, ■ • • , <7jv)> an d = 



(Sqo, Sqi, . . . , SqN), where Sq k £ T qk Q. The discrete one- 
form F d on QxQ approximates the impulse integral between 
the points q k and q k +i, just as the discrete Lagrangian L 
approximates the action integral. We define the maps Ff, F d : 
Q x Q — > T*Q by the relations 

F d (q (hqi )S qi :=F d (q Q ,q 1 )-(0 1 Sq 1 ), 
F d (q Q , qi )5q :=F d (q , qi ) ■ (Sq , 0) . 

The discrete Lagrange-d' Alembert principle may then be 
rewritten as 

n-1 



Sj2 Ld (lk,qk+i) 

k=0 



J2 [ F i (lk,q k +i) Sq k + F d {q k ,q k +l) Sq k +l] = 



fc=0 

for all variations Sq of q that vanish at the endpoints. This is 
equivalent to the forced discrete Euler-Lagrange equations 

F)\L d (q k ,q k+ i) + D 2 L d (q k -i,q k ) 

+ F d (q k ,q k+1 ) + F d (q k - liqk ) = 0. 

III. Matching and Controlled Lagrangians 

A. Controlled Euler-Lagrange Equations 

This paper focuses on systems with one shape and one group 
degree of freedom. It is further assumed that the configuration 
space Q is the direct product of a one-dimensional shape space 
S and a one-dimensional Lie group G. 

The configuration variables are written as q = (0, s), with 
4> £ S, and s £ G. The velocity phase space, TQ, has 
coordinates s, <j>, s). The Lagrangian is the kinetic minus 
potential energy 



L(qA) = \[ot 



}2 



• 2/3(00* + 7 i a ] -V(q), (2) 



with G-invariant kinetic energy. The corresponding controlled 
Euler-Lagrange dynamics is 



d_ dL dL _ 
dt 86 _ ~bl> ~ ' 



d_ dL 

dt ds 



u. 



(3) 
(4) 



where u is the control input. 



B. Continuous-Time Kinetic Shaping 

Assume that the potential energy is G-invariant, i.e., V(q) = 
V((f>), and that the relative equilibria 6 = <p e , s = const 
are unstable and given by non-degenerate critical points of 
V (</)). To stabilize the relative equilibria 6 = 6 e , s = const 
with respect to 6, kinetic shaping is used. The controlled 
Lagrangian in this case is defined by 



Lr,„(q, q) = L(6, 0, s + t(4>)4>) + ia 7 (r(</.)0) 5 



(5) 



where t(6) = nf3(6). This velocity shift corresponds to a 
new choice of the horizontal space (see [8] for details). The 
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dynamics is just the Euler-Lagrange dynamics for controlled 
Lagrangian (O, 



d dL T ^ dL Ta 
dt ,90 d(j> 
d dL T fj 



0. 



0. 



(6) 



(7) 



dt ds 

Lagrangian (0 satisfies the simplified matching conditions of 
[9] when the kinetic energy metric coefficient 7 in © is 
constant. 

Setting u = —d(jT(4>)<p) / dt defines the control input, 
makes equations © and identical, and results in controlled 
momentum conservation by dynamics (0 an d ©■ Setting 
a = — l/7/t makes equations (O and (O reduced on the 
controlled momentum level identical. 

A very interesting feature of systems (01, and ©, (|7]) 
is that the reduced dynamics are the same on all momentum 
levels, which follows from the independence of equations (01 
and (0 of the group velocity s. We will see in Section HVl that 
this property does not hold in the discrete setting, and one 
has to carefully select the momentum levels when performing 
discrete kinetic shaping. 

C. Continuous-Time Potential Shaping 

Now, consider the case when the kinetic energy is group 
invariant, but the potential is not. Consider the special case 
when the potential energy is V(q) — Vi(<fi)-\-V2(s) with V\{<f) 
having a local non-degenerate maximum at (f> e , and the goal 
is to stabilize the equilibrium <fi = cj) e , s — s e . As it becomes 
necessary to shape the potential energy as well, the controlled 
Lagrangian is defined by the formula 

ir : <T,p,e(0, S, <j>, S) = L(<f>, S,(f),S + T(4>)4>) + i(T7(T((/))0) 2 

+ UP - 1)7(* + ~ 1M4>)<P) 2 + V 2 (s) - V s (y), (8) 



where 



y = s 



1/1 p-l 



0e 7 R 



/3(z) dz, 



(9) 



V e (y) is an arbitrary negative-definite function, and (</> e , s e ) is 
the equilibrium of interest. 

Below we assume that <fr e = 0, which can be always 
accomplished by an appropriate choice of local coordinates 
for each (relative) equilibrium. 

IV. Discrete Shaping 

A. Discrete Controlled Dynamics 

In discretizing the method of controlled Lagrangians, we 
combine formulae ([T), ©, and ©. In the rest of this paper, 
we will adopt the notations 

qk+Qk+l a ri \ 

Qk+i/2 = 2 ' Aqk = qk+1 _ qk > qk = ^ fc ' Sk >- 

This allows us to construct a second-order accurate discrete 
Lagrangian 

L d (q k ,q k+1 ) = hL(q k+1/2 ,Aq k /h). 



Thus, for a system with one shape and one group degree of 
freedom the discrete Lagrangian is given by the formula 



L d {qk,qk+i) = ~ 



a {—fo- ) + 2 P( ( Pk+l/2 



+ 7 



h h 
hV(q k+1/2 ). (10) 



The discrete dynamics is governed by the equations 

dL d (q k ,q k+ i) dL d (q k _ 1 ,q k ) 



d<j> k d4> k 
dL d (q k ,q k+1 ) dL d (q k -i, q k ) 
ds k ds k 
where u k is the control input. 



0. 



= —Uk, 



(11) 
(12) 



B. Kinetic Shaping 

At first, it will be assumed that the potential energy is G- 
invariant, i.e., V(q) — V ((/)), and that relative equilibria <fi k = 
0, As k = const of (fTTT) and (fl2l) in the absence of control input 
are unstable. We will see that one needs to either appropriately 
select the momentum levels or introduce a new parameter into 
the controlled Lagrangian to complete the matching procedure. 

Motivated by the continuous-time matching procedure (see 
Section Hilt , we define the discrete controlled Lagrangian by 
the formula 

L T,a(lk,qk+i) = hL Ti<T (q k+1 / 2 , Aq k /h) 

L{<j> k+h , Afa/h, As k /h + K/ 3(0 fe+ 1 )A<j, k /h) 



+ 



^(«/?(^ + i)A&//i 



(13) 



where L T rT (q, q) is the continuous-time controlled Lagrangian. 
The dynamics associated with ( fl~3T > is 



9L d Jq k ,q k+ i) , dL d Jqk-i, Qk) 



d(j) k dcj) k 
9L d (q k ,q k +i) , dL d Jq k -i, qk] 



= 0, 



0. 



(14) 



(15) 



ds k ds k 
Equation < fT3T > is equivalent to the discrete controlled momen 



turn conservation: 



Pk = M) 



(16) 



where 



Pk = -j—L d ., rT (q k ,q k+1 ) 
os k 

= (l + 7^)/3(0fc+i/2)A0 fc +7Asfc 
h 



Setting 



u k = 



7A0fcr(0 fe+1 / 2 ) - 7A^fe_ir(0 fe _i/ 2 ) 



(17) 



(18) 



makes equations ( fT2l and ( fT~5b identical and allows one to 
represent the discrete momentum equation (fT2l as the discrete 
momentum conservation law 



Pk =p. 



(19) 
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Theorem 1: The dynamics determined by equations ( 1111 ) 
and ( 1121 ) restricted to the momentum level Pk — P is equivalent 
to the dynamics of equations ( 1141 ) and (1 1 5b restricted to the 
momentum level p k — fi if and only if the matching conditions 

' M = i — ~~7~7- (20) 



1 + 7K 



hold. 

Proof: Solve equations ( fT6] l and ( fT9T > for Asfc and 
substitute the solutions in equations (fTTb and ( TBI ), respectively. 
This process is a simple version of discrete reduction [14]. 
A computation shows that the equations obtained this way are 
equivalent if and only if 



h 



p — p + jk^jl d 



Wfc+l/2 



A<t> k 



+ 



+ /5 2 (^.- 1/2 )(% i ) 



P{<t>k-l/2 



A(f> k 



0. (21) 



Since f3(4>) ^ and A(j> k ^ generically, equations ( fTTT i and 
( fT2b are equivalent if and only if 

fl — p + "/Kfl = 0, « + 7<7K 2 , 

which is equivalent to ( f20b Note that the momentum levels p 
and /i are «of the same. ■ 

Remark. As ft, — > 0, formulae (TT~8T > and ( f2Tb become 

d, 

u = -jM 



and 



-( K + 7™ 2 )(/3 2 (</# + /?(<«/3' 



0, 



respectively. That is, as h — ► 0, one recovers the continuous- 
time control input and the continuous-time matching condition, 
(7 = —1/jk. Condition /i = p/(l + jk) becomes redundant 
after taking the limit, i.e., the reduced dynamics can be 
matched on arbitrary momentum levels in the continuous-time 
case, which agrees with observations made in Section Hill 

We now discuss an alternative matching procedure. Define 
the discrete controlled Lagrangian G ^(qk? Qk+i] by the 
formula 



L{4> k+ 1 , A4> k /h, Ask/h + 1 )A<f> k /h) 

The discrete dynamics associated with this Lagrangian is 

dA d Jq k ,q k+l ) | dA d Jq k ^,q k ) 



dk d T Jq k ,q k -\ 



dA* (q k -i,q k ) 



= 0, 



= 0. 



ds k ds k 
The discrete controlled momentum is given by formula 

d 



(22) 
(23) 



Pk 



ds k 



A T,<T,A(?fc>9fc+l) 



(1 + 7K)/3(0 fc+1/2 )A(/) fc + jAs k 



(24) 



and equation (1231 1 is equivalent to the discrete momentum 
conservation ( fl9l . 

Theorem 2: The dynamics (lilt and (1121 ) restricted to the 
momentum level pk — p is equivalent to the dynamics (1221 ) 
and ( 1231 ) restricted to the same momentum level if and only if 
the matching conditions 

a= — -, X=-p. (25) 

hold. 

Proof: Similar to the proof of Theorem[T] solve equation 
( fT9t for Ask and substitute the solution in equations ( fTTT i and 
( T22l . respectively. A computation shows that the equations 
obtained this way are equivalent if and only if 



(up + kX) 



d 



Ah 



+ 



fe+1/2 
2 d 



dcj)k 



P(4>k-l/2, 
■2, \ ( 

A4>k-i 



A<f> k -i 



fc-l/2 



0, (26) 



which implies ( 1251 ). Note that in this case we add an extra 
term to the controlled Lagrangian which eliminates the need 
for adjusting the momentum level. ■ 

Remark. The ratio A^ ctA //i becomes Lf a + \K0(tp)(p as 
h — ► 0. That is, as we let the time step go to 0, we obtain 
the continuous-time controlled Lagrangian modified by a term 
which is a derivative of the function Xk J (3(<f>) d<fi with respect 
to time. It is well-known that adding such a derivative term to 
a Lagrangian does not change the dynamics associated with 
this Lagrangian. 

The stability properties of the relative equilibria <p k = 0, 
s k = const of equations ( fTTT i and ( fT2b are now investigated. 

Theorem 3: The relative equilibria <j) k = 0, As k = const of 
equations dill ) and d 1 2b . with Uk defined by d 1 8b . are spectrally 
stable if 

«7-/3 2 (0) 



K > 



/? 2 (0)7 



(27) 



Proof: Let V"(0) = -C, where C > (see SectionED- 
The linearization of the reduced dynamics (fTTb and ( Tf2b at 
4> = is computed to be 



ct7-/3 2 (0) -/3 2 (0) 7 k 
h^f 



(A<j> 
C 



fe-i 



A<t> k 



+ -(0 fc _i+20 fe + fe+1 ) = O. (28) 

Observe that the value of p does not affect the linearized 
dynamics. 

The linearized dynamics preserves the quadratic approxi- 
mation of the discrete energy 



a7-/3 2 (0)-/3 2 (0) 7 /c/A^ 



27 



h 2 



G A? 



(29) 



The equilibrium 4> k = of ( |28b is stable if and only if the 
function ( |29l is negative-definite at cf) k — (f>k+i = 0. The latter 
requirement is equivalent to condition ( fZTl i. ■ 
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Remark. The stability condition d27| i is identical to the sta- 
bility condition of the continuous-time cart-pendulum system, 
and it can be rewritten as 



/3 2 (0) 



< a < 0. 



a 7 -/? 2 (0) 

The spectrum of the linear map {<fi k -i, <fi k ) >-* (^fcj^fc+i) 
defined by d28l belongs to the unit circle. Spectral stability in 
this situation is not sufficient to conclude nonlinear stability. 

We now modify the control input (fT~8T > by adding the kinetic 
discrete dissipation-emulating term 

D{&4> k -i + A0 fc ) 
2h 

in order to achieve the asymptotic stabilization of the upward 
position of the pendulum. In the above, D is a positive 
constant. The discrete momentum conservation law becomes 

D<j> k +l/2 



Pk 



P- 



Straightforward calculation shows that the spectrum of the 
matrix of the linear map (<frk-i,4>k) (</>fc> </>fc+i) defined 
by the reduced discrete dynamics belongs to the open unit 
disc. This implies that the equilibrium <fi = is asymptotically 
stable. 

C. Potential Shaping 

Recall that the the discrete dynamics associated with dis- 
crete Lagrangian (TToT > is governed by equations (fTTT i and (fT2] >. 
where u k is the control input. The goal of the procedure de- 
veloped in this section is to stabilize the equilibrium (<fi, s) = 
(0, 0) of <HD and O- 

Motivated by (0, we define the second-order accurate 
discrete controlled Lagrangian by the formula 

Mk,1k+i) = hL Tia<Pie (q k+1/2 , Aq k /h), (30) 

where q k = ((j) kt s k ). 

The dynamics associated with d30b is amended by the term 
w k in the discrete shape equation: 



rd 

T,<T,p,E \ 



:(?fe-l,<?fe) 



Mk,Qk 



+1; 



,(ik-i,qk) 



0. 



(31) 



(32) 



ds k dsk 
This term w k is important for matching systems ( fTTT i. ( fT2b 
and ( I311 l, d321 l. The presence of the terms w k represents an 
interesting (but manageable) departure from the continuous 
theory. Let 

J k = pj(As k /h -(a- l)T((f> k+ i)A(j) k /h). 

The following statement is proved by a straightforward calcu- 
lation: 

Theorem 4: The dynamics (11 U . (112l l is equivalent to the 
dynamics (1311 ), (132b ant/ on/y */ ant/ u>fc are given by 
h 



h 



2p 



-/A4> k T((j) k+1/2 ) - 7A0 fc _ 1 T(0 fc _ 1/2 ) 



(33) 



and 



(l - a + -\ (r(<P kH ) [ ~ 1P J k + \vi{y k+h ) 



+ T{(f> k _l)^fpJk-l 
~ T'((f) k+ l)J k A<t> k - T'(<f> k _l)J k -lA(f>k-lj, 

where y k is obtained by substituting <f> k and s k in formula (|9). 
Remark. Equations (TTTb . ( fT2l define closed-loop dynamics 
when u k is given by formula ( f33l >. The terms u>fc vanish when 
/?(</>) = const as they become proportional to the left-hand 
side of equation d32l . 

As in the case of kinetic shaping, the stability analysis 
is done by means of an analysis of the spectrum of the 
linearized discrete equations. We assume that the equilibrium 
to be stabilized is (<j> k , s k ) — (0, 0). 

Theorem 5: The equilibrium (<f> k , s k ) = (0, 0) of equations 
d3~TT l and ( l32l is spectrally stable if 



/? 2 (0) 



<cr<0, p<0, and V"(0) < 0. (34) 



a~/-(3 2 (0) 
Proof: The linearized discrete equations are 

r(<7fc-l,9fc) 



d<j) k 



dC d 



<Pfc 
(<?fc- 



= o, 



(35) 



i,9fe) 



<9s fc 



0, (36) 



where L d a p e (q k , q k +i) is the quadratic approximation of 
L d . ape at the equilibrium (i.e., (3(<f)), Vi ((f)), and V £ (y) in 
L^JJ e are replaced by /3(0), ±VY'(O)0 2 , and ±V;"(0)?/ 2 , re- 
spectively). Note the absence of the term w k in equation ( I35I ). 

The linearized dynamics preserves the quadratic approxi- 
mation of the discrete energy E k , k +i defined by 



a 7 cr 2 - /3(0) 2 (cr - l)(p(a - 1) - a) 



2-/a 2 h 

/?(0)p(o- ~ 1) 
ah 



TP 



A^ fc As fc + ^-A^ 



+ ^'(0)^+1 +^"(0)3^+1, (37) 



where 

x = s + (e=l-l)m.t. (38) 
VP cry 7 

Since V/'(0) is negative, the equilibrium (4> k ,s k ) = (0,0) of 
equations ( f35l > and d36*l l is stable if the quadratic approximation 
of the discrete controlled energy ( f37l > is negative-definite. 
The latter requirement is equivalent to conditions d34l . The 
spectrum of the linearized discrete dynamics in this case 
belongs to the unit circle. ■ 

Remarks. Spectral stability in this situation is not sufficient 
to conclude nonlinear stability. The stability conditions ( [34l 
are identical to the stability conditions of the corresponding 
continuous-time system. 

Following [9], we now modify the control input d33l by 
adding the potential discrete dissipation-emulating term 

L»(Ay fc _i + Ay k ) 



2h 



(39) 



ft 



in order to achieve the asymptotic stabilization of the equi- 
librium (<fi k ,s k ) = (0,0). In the above, D is a constant. The 
linearized discrete dynamics becomes 

5£ r,<T, P , £ (9fc,9fc+i) , d£* j<T}Pje (q k -i,qk) 



k CHPk 

p-1 1 \ f3(0) D(Ax k ^ + Ax k ) 



p a J 7 2h 



dsi 



ds k 

DjAxk-! + Ax k ) 
2h 



, (40) 



, (41) 



where x k is obtained by substituting <p k and s k in formula 



Theorem 6: The equilibrium {(p kl s k ) — (0, 0) of equations 
d401 > and (1411 ) is asymptotically stable if conditions ( |27| > are 
satisfied and D is positive. 

Proof: Multiplying equations d40l and dm by (A<^fc_i + 
A<fi k )/2 and (Asu + As k )/2, respectively, we obtain 



Dh 

E k ,k+i — £*-i,k H — 



2/; 



where E k , k+ i is the quadratic approximation of the discrete 
energy (129) . Recall that E k k+ \ is negative-definite (see the 
proof of Theorem [5). It is possible to show that, in some 
neighborhood of (<fi k ,s k ) = (0,0), the quantity Ax k _i + 
Ax k ^ along a solution of equations d40l and ( |4TT > unless 
this solution is the equilibrium (<fi k ,s k ) — (0,0). Therefore, 
Ek,k+i increases along non-equilibrium solutions of d40b and 
fiTI) . Since equations (l40l and (ETl i are linear, this is only 
possible if the spectrum of d40l and d4l"l i is inside the open unit 
disk, which implies asymptotic stability of the equilibrium of 
both linear system d40l and d4Tb and nonlinear system ( fTTT > and 
dT2b with potenital discrete dissipation-emulating term d39b 
added to u k . ■ 

V. Stabilization of the Discrete 
Pendulum on the Cart 

A basic example treated in earlier papers in the smooth 
setting is the pendulum on a cart. Let s denote the position 
of the cart on the s-axis, denote the angle of the pendulum 
with the upright vertical, and ip denote the elevation angle of 
the incline, as in Figure [T] The configuration space for this 
system is Q — S x G — S 1 x R, with the first factor being 
the pendulum angle <f> and the second factor being the cart 
position s. The symmetry group G of the kinetic energy of the 
pendulum-cart system is that of translation in the s variable, 
so G = R. 

The length of the pendulum is I, the mass of the pendulum 
is m and that of the cart is M. 

For the cart-pendulum system, a, 0(4>), 7, are given by 

a = ml 2 , (3((f>) — ml cos(0 — ip), 7 = M + m. (42) 

The potential energy is V(q) — Vi(<f>) + V^s), where 

Vi(4>) = —mgl cos 4>, V^s) = —73s sin ip. 




Fig. 1 . The pendulum on a cart going down an inclined plane under gravity. 
The control force is in the direction s, the overall motion of the cart. 



Note that aj — f3 2 (<fi) > 0, and that the potential energy 
becomes G-invariant when the plane is horizontal, i.e., when 

= 0. 

Since the Lagrangian for the cart-pendulum system is of 
the form ©, the discrete control laws (JTSj and < f33T > stabilize 
the upward vertical equilibrium of the pendulum. As in the 
continuous-time setting, the cart is stabilized by symmetry- 
breaking controller < f33T > and is not stabilized by symmetry- 
preserving controller ([ToT i. 

Simulations of the discrete cart-pendulum system are shown 
in the next section. 

VI. Simulations 

Simulating the behavior of the discrete controlled Lagran- 
gian system involves viewing equations (fTTT l and d32l ) as an 
implict update map $ : Qfc-i) >-> (qk-i,Qk)- This 

presupposes that the initial conditions are given in the form 
(qo,q%)', however it is generally preferable to specify the 
initial conditions as (<?o>9o)- This is achieved by solving the 
boundary condition 

dL 

— (q ,q ) + D 1 L d (q Q ,q 1 ) +F?(q , qi ) = 

for qi. Once the initial conditions are expressed in the form 
(qo,qi), the discrete evolution can be obtained using the 
implicit update map $. 

We first consider the case of kinetic shaping on a level 
surface (with ip — 0), when n is twice the critical value, 
and without dissipation. Here, h — 0.05 sec, m = 0.14kg, 
M = 0.44kg, and I = 0.215 m. As shown in Figure |2] the 
cf> dynamics is stabilized, but since there is no dissipation, the 
oscillations are sustained. The s dynamics exhibits both a drift 
and oscillations, as potential shaping is necessary to stabilize 
the translational dynamics. 

When dissipation is added, the <fi dynamics is asymptotically 
stabilized, as shown in Figure [3] However, even though the 
oscillations are damped, the s dynamics retains a drift motion, 
as expected. 

We next consider the case of potential shaping on an 
inclined surface (with ip = ^ radians) without dissipation, 
with the other physical parameters as before. Here, our goal 
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is to regulate the cart at s = and the pendulum at 4> = 0. 
We set V e — — | j/ 2 . The control gains are chosen to be 
n = 20, p = -0.02, and s = 0.00001. It is worth noting 
that the discrete dynamics remain bounded near the desired 
equilibrium, and this behavior persists even for significantly 
longer simulation runs involving 10 6 time-steps. To more 
clearly visualize the dynamics, we only include a 4000 time- 
step segment of this computation in Figure |4] The exceptional 
stability of the discrete controlled trajectory can presumably 
be understood in terms of the bounded energy oscillations 
characteristic of symplectic and variational integrators. 
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Fig. 4. Discrete controlled dynamics with potential shaping and without 
dissipation. The discrete controlled system stabilizes the motion about the 
equilibrium; since there is no dissipation, the oscillations are sustained. 
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Fig. 2. Discrete controlled dynamics with kinetic shaping and without 
dissipation. The discrete controlled system stabilizes the 4> motion about the 
equilibrium, but the s dynamics is not stabilized; since there is no dissipation, 
the oscillations are sustained. 



stabilizing control law, as illustrated in Figure [5] This is 
consistent with the stability analysis of Section [V] 
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Fig. 3. Discrete controlled dynamics with kinetic shaping and dissipation. 
The discrete controlled system asymptotically stabilizes the <j> motion about 
the equilibrium; since there is no potential shaping, the s dynamics is not 
stabilized, and there is a slow drift in s. 



When dissipation is added, we obtain an asymptotically 
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Fig. 5. Discrete controlled dynamics with potential shaping and dissipation. 
Here the oscillations die out and both the cart position and the pendulum 
angle converge to their desired values s = and = 0. 



VII. Model Predictive Controller 

We now explore the use of the forced discrete Euler- 
Lagrange equations as the model in a real-time model pre- 
dictive controller, with piecewise constant control forces. Al- 
gorithm 1 below describes the details of the procedure. 

The digital controller uses the position information it senses 
for t — —2h, —h to estimate the positions at t = 0, h during 
the time interval t — [—h,0]. This allows it to compute a 
symmetric finite difference approximation to the continuous 
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Algorithm 1 Digital Controller ( q(-),Tf,h) 

q <— sense q(0) 
qi <— sense q(h) 

q 2 <- solve D 2 L d (q a ,q 1 ) + D 1 L d (q 1 ,q 2 ) = 

q 3 «- solve D 2 L d { qi ,q 2 ) + Z?ii d (g 2 ,9 3 ) + F?(q 2 ,q 3 ) = 
, , / 92+93 g3-g2 \ 

"2+1/2 <- " (~ §— . —ft— J 

actuate it = M2+1/2 f° r t G [2ft, 3ft] 
q 2 <— sense </(2ft) 

g 3 «- solve D 2 L d { qi ,q 2 ) + D 1 L d {q 2 , q 3 ) + F d (q 2 ,q 3 ) = 
q± <- solve D 2 L d (q 2 ,q 3 ) + £>i£ d (g 3 , g 4 ) 

+F d (q 2l q 3 ) + F d (q 3 , q A ) =0 

„ ,„<_». f 93+94 94 ~g3 \ 

"3+1/2 <- u (,^— , —ft— J 
actuate u = ^3+1/2 for t £ [3ft, 4ft] 
for k = 4 to (T)/ft - 1) do 
^fc-i <— sense - l)ft) 

g fc <- solve D 2 L d {q k _ 2 , q k _ x ) + D 1 L d {q k _ 1 , q k ) 

+F d (q k - 2 ,q k ^ 1 ) + F d {q k - U q k ) = 
«- solve D 2 L d (q k ^ ll q k ) + D x L d \q k . q k+1 ) 

+F d (q k _ 1 ,q k )+F d (q k ,q k+1 ) = 

«fe+l/2 <~ " ^ 2 ' ft J 

actuate u = Ufe+1/2 for i e [fcft, (A; + l)ft] 
end for 



control force u(</>, s, <f>, s) at t = ft/2 using the approximation 

(4>0 + 4>l S + Si 01-00 si~s \ 

Ul / 2 = U {—2-> —2~> —h~> —tT) ' 

where the overbar indicates that the position variable is being 
estimated by the numerical model. This control is then applied 
as a constant control input for the time interval [0, ft]. This 
algorithm can be implemented in real-time if the two forward 
solves can be computed within the time interval h. On a 
2.5 GHz PowerPC G5 running MATLAB, two forward solves 
take 63 1 .2 /isec, which is sufficiently fast to drive a digital 
controller with a frequency in excess of 1 .5 kHz. In our simu- 
lation, the digital controller had a frequency of 20 Hz, which 
involves a computational load that is easily accommodated by 
an embedded controller. 

The initialization of the discrete controller is somewhat 
involved, since the system is unforced during the time in- 
terval [0, 2ft] while the controller senses the initial states, 
and computes the appropriate control forces. Consequently, 
a combination of the forced and unforced discrete Euler- 
Lagrange equations are used to predict the initial evolution 
of the system. 

We present the numerical simulation results for the digital 
controller in both the case of kinetic shaping (Figure [6]l and 
potential shaping (Figure |7J. We see that in the case of kinetic 
shaping, the system is asymptotically stabilized in only the 
4> variable, and the s dynamics exhibits a drift, whereas in 
the case of potential shaping, the system is asymptotically 
stabilized in both the <\> and s variables. Notice that the use of a 
piecewise constant control introduces dissipation-like effects, 
which are reduced as the time-step is decreased. 
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Fig. 6. The discrete real-time piecewise constant model predictive controller 
with kinetic shaping stabilizes <fi to zero, but not s. 
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Fig. 7. The discrete real-time piecewise constant model predictive controller 
with potential shaping stabilizes <j> and s to zero. 

VIII. Conclusions 

In this paper we have introduced potential shaping tech- 
niques for discrete systems and have shown that these lead to 
an effective numerical implementation for stabilization in the 
case of the discrete cart-pendulum model. The method in this 
paper is related to other discrete methods in control that have a 
long history; recent papers that use discrete mechanics in the 
context of optimal control and celestial navigation are [11], 
[15], [16], and [23]. The method of discrete controlled La- 
grangians for systems with higher-dimensional configuration 
space and with non-commutative symmetry will be developed 
in a forthcoming paper. 
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